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This  final  report  describes  efforts  to  develop  a  resource  management  system  for 
U.S.  Marine  Corps  (USMC)  combat  units  to  improve  the  level  of  combat  readiness. 
Specifically,  this  report  delineates  the  conceptual  framework,  technical 
characteristics,  and  operational  capabilities  of  the  prototype  benefit-cost 
model  and  accompanying  computer  software  (called  CTRACES)  being  developed  for 
the  Marine  Corps  Training  Requirements  and  Cost  Evaluation  System  (TRACES) . 
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The  general  level  of  combat  readiness  throughout  the  Armed  Forces  depends 
on  the  allocation  of  DoD  resources.  The  ideal  way  to  handle  this  classic 
resource  management  problem  is  to  allocate  the  resources  necessary  to  cor¬ 
rect  any  discrepancies  between  the  current  level  of  combat  readiness  on  one 
\v  hand,  and  U.S.  national  security  goals  and  command  missions  on  the  other. 

The  objective  of  this  prototype  system  is  to  assist  battalion  commanders  in 
developing  cost-effective  strategies  for  allocating  funds  for  remedial 
training  based  upon  their  unit's  Marine  Corps  Combat  Readiness  Evaluation 
System  (MCCRES)  scores. 

Resource  management  systems  have  two  broad  components:  an  evaluation 
system  and  an  allocation  system.  In  1976-1977,  the  Defense  Advanced  Research 
Projects  Agency  (DARPA)  funded  the  development  of  a  prototype  evaluation 
methodology  for  MCCRES  which  was  adopted  by  the  USMC  in  1977  as  their 
standard  combat  readiness  assessment  method.  DARPA  also  funded  the  develop¬ 
ment  of  CTRACES,  which  is  the  allocation  component  of  the  resources  management 
system.  With  CTRACES,  battalllon  commanders  will  be  able  to  identify  how 
many  points  and  what  percentage  of  the  MCCRES  deficit  their  battalion  can 
be  expected  to  make  up  for  the  best  package  of  remedial  training  options  at 
a  specific  dollar  level  of  cost.  In  addition,  battalion  commanders  will  be 
able  to  evaluate  the  expected  benefit  and  cost  of  particular  training 
packages  that  they,  or  others,  have  proposed  for  consideration.  Field 
testing,  expected  for  the  fall  of  1980,  is  necessary  to  modify  and  improve 
the  system. 
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EXECUTIVE  SUMMARY 


This  final  report  describes  the  conceptual  framework, 
technical  characteristics,  and  operational  capabilities  of 
the  prototype  benefit/cost  model  and  accompanying  computer 
software  developed  by  Decisions  and  Designs,  Inc.  (DDI)  for 
the  Marine  Corps  Training  Requirements  and  Cost  Evaluation 
System  (TRACES) .  The  computerized  system  will  be  called 
CTRACES,  for  Computerized  Training  Requirements  and  Cost 
Evaluation  System.  Its  objective  is  to  assist  battalion 
commanders  in  developing  cost-effective  strategies  for  allo¬ 
cating  funds  for  remedial  training  based  upon  their  unit's 
Marine  Corps  Combat  Readiness  Evaluation  System  (MCCRES) 
scores. 

To  accomplish  its  objective,  CTRACES  will  be  capable  of 
providing  a  battalion  commander  with  the  following  informa¬ 
tion:  (1)  those  areas  in  which  the  battalion  exhibited 

performance  deficits  in  the  course  of  its  MCCRES  evaluation; 
(2)  the  different  training  options  (or  activities)  that  can 
be  exercised  to  improve  performance  on  individual  tasks 
within  each  Mission  Performance  Standard  (MPS) ;  (3)  the 
projected  remedial  training  benefit  of  each  option  for  tasks 
within  each  MPS;  (4)  the  projected  cost  of  each  training 
option;  (5)  the  projected  improvement  in  combat  readiness 
that  can  be  expected  for  specific  expenditures  of  training 
funds;  (6)  the  expected  cost  required  to  improve  the  bat¬ 
talion's  combat  readiness  by  a  specific  amount;  and  (7) 
better  (more  improvement  for  the  same  cost)  and  cheaper 
(less  cost  for  the  same  improvement)  alternatives  to  a 
specified  training  package. 
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1.0  INTRODUCTION 


Combat  readiness  is  the  primary  goal  of  the  Department 
of  Defense  (DoD) .  In  the  final  analysis,  virtually  all  of 
the  resources  of  DoD  are,  or  should  be,  dedicated  to  pro¬ 
viding  and  maintaining  combat-ready  ground,  sea,  and  air 
forces  for  the  maintenance  of  U.S.  national  security. 
Implicit  in  that  goal  is  the  presumption  that  combat  readi¬ 
ness  is  directly  related  to  deterrence  and  to  the  likely 
effectiveness  of  armed  forces,  should  they  become  engaged  in 
actual  combat.  In  this  context,  combat  readiness  is  that 
organizational  quality  which  reflects  the  level  of  prepared¬ 
ness  for  future  combat. 

The  general  level  of  combat  readiness  throughout  the 
Armed  Forces  depends  on  the  allocation  of  DoD  resources. 
Changes  in  the  allocation  of  defense  resources  undoubtedly 
cause  corresponding  changes  in  the  level  of  combat  readi¬ 
ness.  That  relationship  suggests  that  the  pursuit  of  combat 
readiness  is  a  classic  problem  in  resource  management,  one 
that  is  explained  in  the  following  paragraphs. 

Ideally,  as  depicted  in  Figure  1-1,  DoD  resource  mana¬ 
gers  would  regularly  sample  and  compare  the  current  level  of 
combat  readiness  with  existing  U.S.  national  security  goals. 
The  direction  and  extent  of  the  deviation  of  the  state  of 
readiness  from  those  goals  would  then  stimulate  the  allo¬ 
cation  of  those  particular  DoD  resources  necessary  to  cor¬ 
rect  the  discrepancy. 


Figure  1-1 


DOD  MANAGEMENT  OF  COMBAT  READINESS 


The  same  feedback  and  control  logic  also  applies  to 
the  management  of  force  combat  readiness  by  the  appropriate 
headquarters  command  and  to  the  management  of  unit  combat 
readiness  by  force  commanders  (Figure  1-2) . 


Figure  1-2 

COMMAND  MANAGEMENT  OF  COMBAT  READINESS 


This  ideal  framework  simply  reflects  the  principle  that 
the  combat  readiness  of  a  military  unit  is  always  the 
responsibility  of  the  next  superior  command.  At  each  command 
level,  the  commander  influences  the  combat  readiness  of  the 
subordinate  units  by  managing  and  allocating  the  available 
resources,  or  by  requesting  the  unavailable  resources  that 
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are  necessary  to  correct  any  deviation  in  the  required  level 
of  combat  readiness  consistent  with  the  mission  of  the 
command . 


The  practical  implementation  of  the  ideal  approach 
depicted  in  the  above  figures  is  difficult,  however,  because 
of  the  complex  relationship  between  resource  allocation  and 
combat  readiness.  Unfortunately,  it  is  also  largely  an 
ambiguous  one,  at  present.  There  is  no  organizing  framework 
within  which  DoD  managers  and  military  commanders  can  readily 
associate  and  compare  the  reported  state  of  combat  readiness 
with  specified  national  security  goals  and  command  missions 
in  order  to  determine  discrepancies  and  initiate  corrective 
action.  As  a  result,  DoD  resources  are  too  often  allocated 
with  little  understanding  of  the  impact  the  resources  will 
have  on  the  general  state  of  combat  readiness  or,  at  the 
lower  levels  of  command,  on  the  combat  readiness  of  specific 
military  units. 

Effective  DoD  resource  management  for  combat  readiness 
requires  implementation  of  an  organizational  framework  that 
integrates  U.S.  national  security  goals  with  the  combat 
readiness  of  U.S.  Armed  Forces  at  the  force,  command,  and 
unit  levels,  as  illustrated  in  Figures  1-1  and  1-2.  This  is 
a  difficult  goal,  and  one  that  will  take  many  years  to 
complete.  This  final  report  describes  efforts  by  DDI  to 
develop  a  prototype  resource  management  system  for  U.S. 

Marine  Corps  (USMC)  combat  units  and  represents  a  step 
toward  achieving  that  difficult  goal. 

Resource  management  systems  have  two  broad  components: 
an  evaluation  system  and  an  allocation  system.  In  1976-1977 
the  Defense  Advanced  Research  Projects  Agency  (DARPA)  agreed 
to  fund  an  exploratory  development  effort  that  lead  to  a 
prototype  evaluation  methodology  for  the  Marine  Corps  Combat 
Readiness  Evaluation  System  (MCCRES) .  DARPA  supported  the 
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MCCRES  development  effort  under  the  Advanced  Decision  Tech¬ 
nology  Program  and  arranged  for  the  program's  prime  contrac¬ 
tor,  DDI,  to  work  closely  with  Marine  Corps  personnel  in 
developing  a  sound  methodological  approach.  Combining  the 
substantive  expertise  supplied  by  five  Marine  Corps  officers 
assigned  to  the  MCCRES  project  with  proven  decision  analysis 
methodology,  DDI  constructed  a  prototype  multi-attribute 
utility  assessment  (MAUA)  model  that  permitted  a  rapid  and 
systematic  assessment  of  combat  readiness.  The  model  was 
successfully  tested  by  the  Marine  Corps  in  August  1977,  and 
MCCRES  was  adopted  as  the  standard  combat  readiness  assess¬ 
ment  method  for  that  Service.  The  implementing  software  for 
the  assessment  model,  originally  written  by  DDI  for  the  IBM 
5100  computer,  was  rewritten  to  permit  implementation  of  the 
model  on  the  IBM  S/360  computer  at  Headquarters,  USMC. 

MCCRES  and  its  software  model,  MCCRESSA,  MCCRES  Software 
Application,  are  now  in  routine  use  throughout  the  Marine 
Corps  with  over  190  MCCRES  evaluations  having  now  been  con¬ 
ducted. 

DARPA  has  funded  DDI's  efforts  to  construct  a  prototype 
cost-benefit  model  and  accompanying  computer  software  for 
the  Marine  Corps  Training  Requirements  and  Cost  Evaluation 
System  (TRACES).  The  computerized  system  is  called  CTRACES, 
for  Computerized  Training  Requirements  and  Cost  Evaluation 
System.  The  cost-benefit  model  within  CTRACES  uses  the  com¬ 
bat  readiness  evaluation  scores  generated  by  the  MAUA  model 
within  MCCRES  and  the  costs  of  the  various  remedial  training 
options  as  individually  supplied  by  FMFLant  and  FMFPac  to 
suggest  optimal  allocations  of  remedial  training  dollars  at 
the  battalion  level.  Thus,  CTRACES  is  the  allocation  com¬ 
ponent  of  the  resource  management  system  for  USMC  combat 
units.  The  initial  prototype  version  will  be  field-tested 
in  Fall,  1980.  This  final  report  describes  the  conceptual 
framework,  technical  characteristics,  and  operational  capa¬ 
bilities  of  the  cost-benefit  model  and  accompanying  computer 
software  for  CTRACES. 
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2 . 0  TECHNICAL  APPROACH 


2 . 1  Conceptual  Framework 

The  resource  management  system  for  USMC  combat  units 
has  two  major  components:  (1)  an  explicit  evaluation  model 
that  specifies  how  well  the  combat  unit  is  performing  each 
of  its  primary  tasks,  and  (2)  an  explicit  training  model 
that  specifies  the  most  benefical  remedial  training  activi¬ 
ties  for  specific  levels  of  cost.  The  components  have  been 
computerized  so  that  they  can  provide  immediate  post-evalua¬ 
tion  information  about  the  areas  of  weak  performance  and, 
subsequently,  the  most  cost-beneficial  training  activities. 
Furthermore,  to  ensure  its  utilization,  the  computerized 
system  has  been  designed  in  a  straightforward,  user-oriented 
fashion  and  is  not  overly  time-consuming  to  operate. 

MCCRES  is  the  evaluation  component  of  the  USMC  system. 
MCCRES  incorporates  a  multi-attribute  utility  assessment  (MAUA) 
model  that  permits  the  systematic  assessment  of  a  USMC 
unit's  combat  readiness.  In  general,  MAUA  models  are  hier¬ 
archical  in  structure,  starting  with  the  specified  top-level 
factor  for  which  an  overall  evaluation  score  is  desired. 

This  factor  is  successively  decomposed  into  subfactors  in 
descending  levels  of  the  hierarchy  such  that  each  successive 
level  is  more  specific  than  the  one  preceding.  At  the 
lowest  level  of  the  hierarchy  are  predictable  or  observable 
technical  (or  other)  characteristics  of  the  system  under 
evaluation.  These  lowest  level,  highly  specific  charac¬ 
teristics  are  termed  system  elements. 

Figure  2-1  presents  a  schematic  of  the  MAUA  model  of 
MCCRES  for  USMC  infantry  units.  The  top-level  factor  is  the 
overall  combat  readiness  score.  This  factor  is  decomposed 
into  separate  categories  of  standards  that  specify  the 
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COMBAT  READINESS 


Figure  2-1 

SCHEMATIC  MAUA  MODEL  OF  MCCRES  FOR  INFANTRY  UNITS 


appropriate  mission  performance  standards  (MPS)  for  the 
MCCRES  evaluation.  These  standards  are  decomposed  into 
specific  tasks,  which,  in  turn,  are  decomposed  into  the 
specific  requirements  that  represent  observable  activities. 
Thus,  different  activities  are  integrated  systematically  to 
provide  evaluation  scores  on  individual  performance  areas 
and  thereby  yield  an  overall  performance  score. 

The  MAUA  model  is  used,  as  follows,  to  provide  an 
overall  combat  readiness  score  for  an  infantry  unit. 

First,  USMC  evaluators  rate  whether  the  unit  did  or  did  not 
satisfy  each  of  the  requirements  during  the  MCCRES  evalua¬ 
tion.  The  unit's  score  on  each  task  is  computed  by  dif¬ 
ferentially  weighting  the  ratings  on  the  requirements  com¬ 
prising  that  task.  Consequently,  a  unit  that  failed  to 
satisfy  important  requirements  on  a  task  would  get  a  low 
score  on  that  task;  if  it  failed  certain  demand  require¬ 
ments,  it  could  get  a  score  of  zero  on  that  task.  In  a 
similar  fashion,  the  unit's  score  on  each  MPS  is  computed  by 
differentially  weighting  the  tasks  comprising  that  MPS;  a 
low  score  on  an  MPS  implies  that  the  unit  did  poorly  on 
important  tasks  within  that  MPS.  The  MPS ’ s  are  differentially 
weighted  to  provide  a  score  on  the  standards  which,  in  turn, 
are  differentially  weighted  to  provide  an  overall  combat 
readiness  score  for  the  unit.  The  more  combat  ready  the 
unit,  the  higher  the  overall  score  produced  by  the  MAUA 
model.  Poor  overall  performance  can  be  readily  attributed 
to  poor  performance  on  specific  performance  standards, 
tasks,  and  requirements. 

TRACES  is  the  training  component  of  the  USMC  system;  as 
mentioned  earlier,  the  computerized  system  which  has  been 
developed  by  DDI  is  called  CTRACES.  CTRACES  incorporates 
a  general  cost-benefit  model  that  can  be  tailored  to  the 
needs  of  individual  USMC  battalions,  as  determined  by  their 
MCCRES  evaluation.  As  a  result,  CTRACES  is  capable  of  telling 
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a  battalion  commander  (1)  in  what  areas  the  battalion  per¬ 
formed  weakly  during  its  MCCRES  evaluation;  (2)  the  differ¬ 
ent  training  options  (or  activities)  that  can  be  exercised 
to  improve  performance  on  individual  tasks  within  each  MPS; 
(3)  the  projected  benefit  of  each  option  for  tasks  within 
each  MPS;  (4)  the  projected  cost  of  each  training  option; 

(5)  the  relative  improvement  in  combat  readiness  that  can  be 
expected  for  specific  expenditures  of  training  funds; 

(6)  the  expected  cost  required  to  improve  the  battalion's 
combat  readiness  by  a  specific  amount;  and  (7)  better  (more 
improvement  for  the  same  cost)  and  cheaper  (less  cost  for 
the  same  improvement)  alternatives  to  a  specified  training 
package.  CTRACES  has  been  designed  to  be  an  interactive 
system  that  permits  battalion  commanders  to  ask  questions 
about  these  seven  items  in  order  to  develop  their  actual 
package  of  remedial  training  activities. 

Figure  2-2  represents  a  schematic  of  the  benefit  model 
within  CTRACES.  Again,  the  relation  between  overall  benefit 
and  different  training  options  is  hierarchical  to  ensure  the 
explicit  integration  of  the  evaluation  and  training  compo¬ 
nents  of  the  overall  system.  The  top-level  factor  is  the 
overall  benefit  produced  by  any  proposed  package  of  training 
options.  Overall  benefit  is  decomposed  into  the  benefits 
obtained  for  each  MPS,  which,  in  turn,  is  decomposed  into 
the  benefits  obtained  for  each  of  the  tasks  comprising  the 
MPS.  The  greatest  overall  benefit  is  obtained  by  training 
activities  that  effectively  exercise  important  tasks  within 
important  performance  areas  on  which  the  USMC  unit  performed 
weakly.  The  most  cost-beneficial  training  activities  are 
those  that  most  effectively  exercise  those  tasks  for  the 
level  of  money  allocated  for  training. 

It  is  important  to  point  out  that  CTRACES  cannot  guar¬ 
antee  that  the  indicated  number  of  points  or  percentage  of 
deficit  made  up  will  actually  be  achieved  in  a  second  MCCRES 
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evaluation.  These  values  are  expected  values.  They  indi¬ 
cate  that  if  an  infantry  battalion  received  a  particular 
remedial  training  program  immediately  after  its  MCCRES 
evaluation  and  then  participated  in  another  MCCRES  evalua¬ 
tion  immediately  after  completing  this  program,  then,  on  the 
average,  the  battalion  would  achieve  these  values  on  the 
exercised  tasks.  These  values  are  estimates  provided  by 
USMC  experts  which  are  due  to  undergo  field  testing,  and 
they  cannot  be  guaranteed  in  every  case.  Similarly,  CTRACES 
does  not  predict  an  overall  MCCRES  score  because  remedial 
training  programs  seldom  provide  training  on  tasks  which  the 
battalion  performed  well  during  its  MCCRES  evaluation. 
Consequently,  one  cannot  be  sure  that  the  battalion  will 
perform  these  tasks  well  again.  Presumably,  the  shorter  the 
time  interval  between  MCCRES  evaluations,  the  higher  the 
probability  of  repeated  good  performance. 

In  sum,  CTRACES  has  been  designed  to  help  battalion 
commanders  develop  a  cost-effective  strategy  for  remedial 
training.  They  will  be  able  to  identify  how  many  points  and 
what  percentage  of  the  MCCRES  deficit  their  battalion  can  be 
expected  to  make  up  for  the  best  package  of  remedial  train¬ 
ing  options  at  a  specific  level  of  cost.  In  addition, 
battalion  commanders  will  be  able  to  evaluate  the  expected 
benefit  and  cost  of  particular  training  packages  by  using 
CTRACES'  interactive  capabilities.  CTRACES'  technical 
characteristics  are  discussed  in  the  next  section  of  the 
report. 

2.2  Technical  Characteristics 


The  technical  characteristics  of  the  TRACES/CTRACES 
system  can  be  placed  in  three  general  categories:  (1) 
Inputs  to  TRACES/CTRACES:  (2)  the  cost-benefit  algorithm 
used  by  TRACES/CTRACES;  and  (3)  the  outputs  of  TRACES/ 
CTRACES.  These  items  will  be  successively  discussed  in  the 
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following  three  subsections.  In  discussing  outputs,  opera¬ 
tion  of  the  computer  software  will  be  briefly  discussed  as 
will  interpretation  of  the  outputs.  (A  more  elaborate  ex¬ 
planation  appears  in  a  User's  Guide  accompanying  this 
report. ) 


2.2.1  Inputs  to  TRACES/CTRACES  -  The  inputs  to  CTRACES 
are  of  three  types:  (1)  information  on  MCCRES  MPS's  and 
tasks  exercised  and  the  scores  received  on  them;  (2)  infor¬ 
mation  on  remedial  training  options  including  what  they  are, 
their  length,  which  combinations  are  allowed,  and  what  their 
costs  are  for  FMFLant  and  FMFPac ;  and  (3)  the  values  of  the 
remedial  training  options  for  the  individual  tasks  including 
whether  or  not  the  option  is  applicable  to  the  task,  what 
percentage  of  the  deficit  would  be  made  up  if  the  option  is 
applicable,  and  whether  the  option  provides  enhanced  train¬ 
ing  on  the  task. 

2. 2. 1.1  Information  of  MCCRES  MPS's  and  Tasks  - 
CTRACES  must  know  exactly  what  MPS's  and  tasks  were  exer¬ 
cised  during  the  relevant  MCCRES  evaluation  and  what  scores 
were  received  on  them.  CTRACES  is  capable  of  retrieving 
this  information  directly  from  the  MCCRES  disk.  There  are 
seventeen  possible  MPS's  which  might  have  been  chosen  for  a 
MCCRES  evaluation.  There  are  107  possible  tasks  based  on  a 
decomposition  of  these  seventeen  MPS's;  there  are  two  to 
twelve  tasks  for  each  MPS.  Three  MPS's  are  always  chosen 
for  inclusion  in  any  MCCRES  evaluation;  they  are  2.A.1 
(Continuing  Action  by  Marines),  2. A. 2  (Command  and  Control), 
and  2. A. 3  (Fire  Support  Coordination).  Three  to  five  other 
MPS's  are  usually  chosen,  in  addition  to  the  required  MPS's, 
to  create  the  complete  set  of  six  to  eight  MPS's  exercised 
in  the  typical  MCCRES  evaluation.  All  possible  tasks  under 
a  given  MPS  need  not  be  chosen,  however,  for  a  MCCRES  evaluation. 
Consequently,  CTRACES  retrieves  only  the  appropriate  MPS's 
and  tasks  from  the  MCCRESSA  computer  disk  and  stores  it  in 
its  own  files. 

11 
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2.2.1. 2  Information  on  remedial  training  options  - 
Ten  major  remedial  training  options  and  thirty-four  lectures 
make  up  the  total  set  of  training  options.  The  major  options 
are  as  follows:  A  two-,  three-,  or  four-day  Command  Post 
Exercise/Map  Exercise  (CPX);  a  two-,  three-,  or  four-day 
Field  Exercise  (FX) ;  a  two-day  Combined  Arms  Exercise  (CAX) ; 

a  two-day  CPX  combined  with  a  two-day  FX;  a  two-day  CPX  com¬ 
bined  with  a  three-day  FX;  and  a  two-day  CPX  combined  with  a 
CAX.  Each  of  the  thirty-four  possible  lectures  addresses  a 
different  combination  of  tasks.  Any  major  option  might 
potentially  address  all  tasks  requiring  remedial  training; 
the  lectures  cannot  do  so. 

Four  other  major  training  options  are 
treated  in  a  special  way  by  CTRACES  because  it  was  not 
possible  to  capture  cost  lata  for  them.  These  are  one- 
and  two-day  Combined  Planning  Exercises  with  the  Navy  (CPL) 
and  one-  and  two-day  Rehearsals  (REH) . 

Table  2-1  provides  the  remedial  training 
options  and  their  costs  as  supplied  by  FMFLant .  Similar 
data  is  being  supplied  by  FMFPac.  No  cost  data  were  requested 
from  FMFLant  or  FMFPac  for  the  CPL  and  REH  options. 

2. 2.1. 3  The  values  of  the  remedial  training 
options  -  The  first  item  of  information  to  determine  is 
whether  or  not  a  remedial  training  option  can  or  cannot 
provide  remedial  training  for  the  combat  readiness  weak¬ 
nesses  on  a  given  task.  Such  information  can  be  easily 
displayed  using  cross-matrices  of  tasks  by  options,  one  for 
each  MPS.  Figure  2-3  is  such  a  cross  matrix.  A  panel  of 
experts  composed  of  past  and  present  Marine  Corps  Battalion 
Commanders  and  other  Marine  Corps  experts  knowledgeable  in 
the  use  of  MCCRES  made  the  judgments  displayed  in  this 
matrix.  An  X  in  a  cell  indicates  that  the  option  can  pro¬ 
vide  remedial  training.  A  major  option  made  up  of  two  other 
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major  options  can  provide  training  if  either  of  them  can  do 
so.  Appendix  A  contains  a  complete  set  of  matrices,  one  for 
each  MPS.  In  each  matrix,  in  the  column  for  lectures,  it 
has  also  been  indicated  which  of  the  thirty-four  possible 
lectures  would  provide  remedial  training  for  that  task. 
Lectures  provide  remedial  training  on  one  to  eight  different 
tasks . 

If  a  training  option  is  applicable  to  a 
given  task,  CTRACES  needs  to  know  how  much  of  the  deficit 
occurring  on  that  task  can  be  made  up  via  the  option.  This 
datum  was  elicited  from  the  group  of  experts  in  the  form  of 
a  Percentage  of  the  Deficit  Made  Up  (PDMU) .  PDMU  varies  as 
a  function  of  the  length  of  the  training  option  and  the 
score  achieved  on  the  MPS  of  which  the  relevant  task  is  a 
member.  PDMU  is  estimated  as  one  number  for  all  tasks 
belonging  to  a  single  MPS.  The  PDMU  for  major  options  that 
are  combinations  of  others  is  calculated  by  a  mathematical 
expression  given  in  a  subsequent  section  of  this  report. 

Figure  2-4  gives  a  set  of  PDMU  estimates  for  MPS  2.B.4, 

Attack. 

If  the  PDMU  is  estimated  as  100%  for  those 
tasks  in  a  chosen  MPS,  it  is  also  possible  for  the  option  to 
provide  enhanced  training  on  the  tasks.  Enhanced  training 
is  training  on  an  individual  task  that  goes  beyond  remedial 
training,  ensuring  that  activities  performed  properly  during 
the  relevant  MCCRES  evaluation  will  also  be  performed  properly 
on  the  next  evaluation.  If  enhanced  training  is  possible, 

PDMU  appears  as  100+. 

Appendix  B  presents  a  complete  set  of  PDMU 
tables  for  all  MPS's  and  their  tasks.  The  following  section 
provides  details  concerning  the  manipulation  of  the  inputs 
to  CTRACES  which  have  been  described  in  this  section. 
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2.2.2  Data  manipulation  by  CTRACES  -  Based  on  a  MCCRES 
evaluation,  a  battalion  receives  (1)  an  overall  score,  (2) 
scores  on  the  individual  MPS's  exercised,  and  (3)  scores  on 
those  tasks  exercised  as  part  of  each  chosen  MPS.  The 
overall  deficit,  as  well  as  the  deficit  on  each  relevant  MPS 
and  task,  can  be  calculated  by  subtracting  the  score  from 
100.  Since  every  relevant  task  that  has  been  exercised  is 
assigned  a  cumulative  weight  (CUMWT)  in  MCCRES,  the  sum  of 
which  is  100,  the  overall  deficit  is  equal  to  the  sum  of  the 
products  of  the  task  deficits  and  the  task  CUMWTs. 

CTRACES  assumes  that  the  worth  of  performing  the 
various  training  options  (the  PDMU's)  can  be  more  accurately 
judged  at  the  MPS  level  of  the  MCCRES  hierarchy  than  at  the 
task  level.  However,  in  the  TRACES  model  PDMU's  must  be 
applied  at  the  task  level  because  all  options  do  not  apply 
to  all  tasks,  and  different  lectures  apply  to  different 
tasks.  (Requirements,  the  sub-nodes  of  tasks  in  MCCRES,  do 
not  play  a  role  in  CTRACES  other  than  their  being  explicitly 
considered  in  making  judgments  of  the  worth  of  the  training 
options  as  they  apply  to  the  tasks  within  an  MPS . )  USMC 
experts  were  asked  to  assess  PDMUs  at  the  task  level  during 
the  initial  stage  of  the  project.  These  judgments  turned 
out  to  be  quite  difficult  and  time  consuming,  increasing  the 
number  of  assessments  by  a  factor  of  approximately  six, 
since  there  are  about  six  tasks  per  MPS  on  the  average. 
Furthermore,  after  an  initial  set  of  assessments,  it  was 
determined  that  PDMU  variations  are  much  more  significant 
among  tasks  in  different  MPS's  than  among  those  within  the 
same  MPS.  This  is  due  to  the  fact  that  there  is  more  simi¬ 
larity  between  tasks  within  the  same  MPS  than  between  tasks 
in  different  MPSs,  for  tasks  within  the  same  MPS  are  more 
likely  to  be  composed  of  a  comparable  number  of  activities. 
Consequently,  PDMUs  were  assessed  at  the  MPS  level  for  the 
"typical"  or  "average"  task  within  the  MPS,  and  not  for 
individual  tasks  of  the  MCCRES  hierarchy. 


If  a  training  option  is  applicable  to  any  task 
within  a  given  MPS,  the  PDMU  assigned  to  that  task  is  the 
same  for  all  tasks  within  that  MPS.  The  PDMUs  are  invariant 
with  the  magnitude  of  the  deficit  on  a  given  task.  That  is, 
for  a  given  task,  a  certain  training  option  is  estimated  to 
make  up,  for  example,  50%  of  the  deficit  on  that  task, 
whether  the  score  is  20  (and  the  deficit  80)  or  the  score  is 
70  (and  the  deficit  30) .  Assuming  that  a  given  task  will 
have  a  constant  amount  of  time  for  remedial  training  no 
matter  what  the  deficit  on  that  task,  the  above  rule  for 
PDMU's  implies  that  the  greater  the  deficit,  the  greater  the 
number  of  points  that  will  be  made  up.  That  is,  it's  easier 
to  buy  points  (provide  training  that  will  make  up  large 
numbers  of  points)  when  the  deficit  is  large  than  when  the 
deficit  is  small.  Large  deficits  imply  gross  problems  and 
coarser  training  activities.  Small  deficits  imply  minor 
problems  and  finer  training  activities  likely  to  consume  as 
much  time  as  the  coarser  ones  while  buying  few  readiness 
points. 


PDMU's  were  separately  assessed  for  all  training 
options  within  each  MPS.  In  attempting  to  make  these  assess¬ 
ments,  however,  USMC  participants  indicated  that  the  aggregate 
score  on  a  given  MPS  also  affected  the  ability  of  a  training 
option  to  provide  remedial  training  on  the  tasks  within  that 
MPS.  This  is  true  assuming  that  each  MPS  has  been  allotted 
a  fixed  amount  of  time  for  remedial  training  within  a  train¬ 
ing  option.  As  the  score  on  a  given  MPS  decreases,  the 
number  of  tasks  requiring  remedial  training  that  are  part  of 
that  MPS  will  increase.  Hence,  the  amount  of  time  available 
for  remedial  training  for  each  task  will  decrease  and  the 
PDMU  for  each  task  will  decrease. 

In  summary,  the  expected  benefit  or  value  of  a 
training  option  is  represented  by  the  percentage  of  the 
deficit  it  should  make  up  (PDMU)  on  an  MPS.  The  expected 
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benefit  (or  PDMU)  of  a  training  option  for  tasks  within  an 
MPS  depends  on  (1)  the  battalion's  MCCRES  score  on  an  MPS, 

(2)  the  overall  effectiveness  of  the  option  for  training  on 
the  MPS,  and  (3)  the  duration  of  the  training  option.  This 
dependency  is  based  on  three  assumptions.  First,  it  was 
assumed  that  the  better  the  battalion  performed  on  an  MPS, 
the  more  beneficial  the  option  as  a  form  of  remedial  train¬ 
ing.  Second,  it  was  assumed  that  the  more  complete  the 
training  option,  the  greater  the  benefit;  thus,  it  was 
assumed  that  a  CPX  provided  more  benefit  than  a  lecture, 
that  an  FX  provided  more  benefit  than  a  CPX,  and  that  a 
CA+FFX  provided  more  benefit  than  an  FX,  in  general.  And 
third,  it  was  assumed  that  the  longer  the  training  option, 
the  greater  the  benefit.  These  three  assumptions  are  illus¬ 
trated  in  Figure  2-4,  which  shows  the  PDMUs  for  MPS  2B.4: 
Attack. 


In  TRACES,  the  benefit  is  measured  as  the  number 
of  points  made  up  by  a  training  option  or  combination  of 
training  options.  The  Points  Made  Up  (PMU)  on  each  indi¬ 
vidual  task  by  a  given  training  option  (or  combination  of 
options)  must  be  summed  to  yield  the  overall  PMU  for  that 
option.  The  PMU  on  an  individual  task  is  the  product  of  the 
PDMU  for  that  task  and  the  amount  of  the  overall  deficit 
that  was  contributed  by  that  task.  (The  latter  quantity  is 
the  product  of  the  individual  task's  deficit  [100  -  Score] 
and  its  CUMWT.)  To  summarize,  for  a  given  training  option, 

107 

PMU  . ,  =  I  [100  -  Score.]  x  CUMWT.  x  PDMU., 

overall  i_1  i  i  x 

where  i  indexes  the  tasks. 

Major  options  are  not  always  capable  of  pro¬ 
viding  remedial  training  for  each  task.  Marine  Corps  ex¬ 
perts  did  not  make  estimates  of  PDMU  for  the  major  options 
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that  represent  combinations  of  other  options  (e.g.,  CPX2  +  FX2). 
Instead,  a  simple  combination  rule  was  used  to  derive  these 
PDMU's.  The  rule  was  PDMU-  _  =  PDMU,  +  (1.0  -  PDMU_)  x 
PDMUT  or  PDMUt  ,  =  1  -  (1  -  PDMU_ )  x  (1  -  PDMU,),  where  the 
PDMU's  are  expressed  as  decimal  fractions.  Another  charac¬ 
teristic  of  the  TRACES  model  was  that  a  lecture  provides  no 
remedial  training  value  for  a  task  if  a  major  option  is  also 
being  applied  to  that  task.  This  implies  that  major  options 
have  a  lecture  component  built  into  them. 

As  discussed  in  the  previous  section,  another 
feature  of  TRACES  is  Enhanced  Training.  In  certain  in¬ 
stances,  it  is  the  case  that  a  training  option  not  only 
provides  remedial  training  on  those  requirements  of  a  task 
that  were  missed  during  a  MCCRES  evaluation,  but  also  pro¬ 
vides  maintenance  training  on  those  requirements  of  a  task 
that  were  not  missed.  Such  training  is  termed  Enhanced 
Training  as  it  goes  beyond  the  need  for  remediation  on  a 
task.  TRACES  is  designed  to  tell  the  user  how  many  and 
which  tasks  will  be  receiving  Enhanced  Training  for  a  given 
option.  It  is  possible  to  provide  enhanced  training  on  a 
task  even  if  no  remedial  training  was  necessary  (that  is, 
even  if  the  score  on  that  task  was  100) . 

Given  the  above  details,  TRACES  simply  calcu¬ 
lates  the  PMU  for  any  combination  of  a  major  option  and 
lectures  and  also  calculates  the  cost.  The  ratio  of  the  two 
is  then  used  as  a  measure  of  efficiency.  There  are  numerous 
ways  to  manipulate  these  TRACES  data  to  provide  interesting 
and  useful  outputs  for  the  battalion  commanders.  These  are 
discussed  in  the  following  section. 

2.2.3  CTRACES  outputs  -  The  purpose  of  this  section  is 
not  to  provide  the  CTRACES  user  with  a  complete  understand¬ 
ing  of  the  use  of  CTRACES  but  rather  to  give  the  reader  an 
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understanding  of  the  nature  of  CTRACES's  outputs  and  how 
they  should  be  interpreted  and  utilized.  The  outputs  will 
be  discussed  in  the  three  sections  to  follow  as  they  relate 
to  Potential  Points  Made  Up  (PPMU) ,  Pareto  Packages  and 
Major  Options,  and  Specified  Training  Packages. 

2.2. 3.1  Outputs  concerning  points  to  make  up  - 
Output  concerning  points  to  make  up  gives  the  battalion 
commander  specific  information  concerning  his  strengths  and 
weaknesses  on  the  relevant  MCCRES  evaluation.  Figure  2-5 
presents  a  portion  of  the  printout  supplied  concerning 
points  to  make  up.  This  particular  listing  sorts  (from 
greatest  to  least)  MPS's  based  on  the  amount  of  the  overall 
deficit  they  contribute.  Tasks  within  an  MPS  are  similarly 
sorted  under  each  MPS.  In  the  particular  example  presented 
here,  the  overall  deficit  is  45  points.  MPS  2.A.1,  for 
example,  contributes  12.77  points  or  28.19*  of  the  overall 
deficit.  The  two  right-most  columns  give  the  cumulative 
deficit  (CUMDEF)  and  the  cumulative  percentage  of  the  deficit 
(CUM%DEF )  by  MPS.  Here  it  is  the  case  that  the  three  MPS's 
with  the  highest  deficit  contribute  26.75  points  to  the 
overall  deficit  which  is  59.06%  of  that  deficit. 

CTRACES  also  provides  two  other  outputs 
concerning  points  to  make  up.  One  presents  MPS's  and  tasks 
in  an  unsorted  fashion;  the  other  presents  only  tasks  sorted 
by  deficit. 


2.2. 3.2  Outputs  concerning  Pareto  Packages 
and  Major  Options  -  A  Pareto  (remedial  training)  Package  is 
a  combination  of  major  options  and  tasks  that  provides  the 
most  Points  Made  Up  (PMU)  for  a  selected  cost.  Such  a 
package  lies  on  the  Pareto  frontier  (belongs  to  the  Pareto 
set)  of  all  such  packages  spanning  the  entire  range  of 
possible  costs.  It  is  possible  to  plot  in  cost-benefit 
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TRACES  OUTPUTS  CONCERNING  DEFICITS  SORTED 
BY  MPS  AND  TASK 


space  both  the  entire  set  of  Pareto  points  and  those  points 
corresponding  to  the  major  options  and  lectures  (lectures 
alone  and  not  in  conjunction  with  major  options) .  Figure 
2-6  presents  the  plot  of  Pareto  packages;  a  list  of  Pareto 
packages  must  be  used  in  conjunction  with  this  plot  to 
determine  which  package  corresponds  to  the  point.  The  first 
nine  items  from  such  a  listing  appear  in  Figure  2-7.  The 
listing  indicates  the  composition  of  the  relevant  package, 
its  cost,  its  PMU,  and  the  number  of  tasks  for  which  it 
provides  enhanced  training  (#ENH).  Figure  2-8  presents  the 
cost-benefit  plot  for  the  major  options  and  lectures. 

Figure  2-9  presents  a  list  of  cost,  PMU,  and  #ENH  for  the 
lectures  and  major  options.  Notice  that  the  lectures  are 
treated  as  cumulative  in  cost  and  benefit  and  have  been 
ranked  in  terms  of  decreasing  benefit  (the  cost  of  $500  is 
equivalent  for  each  lecture) . 

2.2. 3. 3  Outputs  concerning  Specified  Packages  - 
CTRACES  also  provides  outputs  for  three  types  of  specified 
packages,  those  of  a  specified  cost,  those  of  a  specified 
benefit,  and  those  of  a  specified  composition.  The  user  can 
determine  the  best  package  (that  providing  the  highest  PMU) 
for  a  specified  cost;  the  user  can  determine  the  cheapest 
package  for  a  selected  PMU;  and  the  user  can  determine  the 
cost  and  benefit  of  any  package  of  a  specified  composition 
as  well  as  alternatives  to  that  package  that  are  cheaper  for 
the  same  level  of  benefit  and  better  for  the  same  level  of 
cost.  As  Figure  2-10  shows,  the  user  can  optionally  generate 
a  plot  of  the  cost-benefit  space  with  the  selected,  cheaper, 
and  better  packages  and  the  Pareto  frontier.  And  as  Figure 
2-11  shows,  the  user  can  also  optionally  generate  a  listing 
of  the  points  made  up  for  each  individual  task  by  any  spe¬ 
cified  package.  This  list  provides  the  following  items: 
the  source  of  the  points  (lecture  or  major  option) ,  whether 
the  task  is  receiving  enhanced  training,  the  PMU  for  the 


23 


POINTS  ON  THE  PARETO 
PLOTTED  BY  PMU  AND  COST 


POINTS  ON  THE  PARETO 


COST  PMU 

MAJOR  OPTION:  NONE  500  1.9633 

LECTURES:  L01 

COSI  PMU 

MAJOR  OPTION:  NONE  1000  3.0030 

LECTURES:  L01  L02 

cosj 

MAJOR  OPTION  NONE  1500  3.8171 

LECTURES:  L01  L02  L05 

COST  PMU 

MAJOR  OPTION:  NONE  2000  I+.5278 


LECTURES :  L01  L02  LOS  L08 

MAJOR  OPTION:  CPX2 

MAJOR  OPTION:  CPX2 
LECTURES:  L01 

MAJOR  OPTION:  CPX2 

LECTURES:  L01  Lll 

MAJOR  OPTION:  CPX3 

MAJOR  OPTION:  CPX3 
LECTURES:  L01 

Figure  2-7 


COST  PMU 

2374  14.8574 

COST  PMU 

2874  15.7152 

COST  PMU 

3374  15.7505 

COST  PMU 

3562  13.7071 

COST  PMU 

4062  19.5648 


MENH 

0 

ttENH 

0 

ttENH 

0 

«ENH 

0 

ttENH 

0 

#ENH 

0 

#ENH 

0 

MENU 

0 

ttENH 

0 


LISTING  OF  POINTS  ON  THE  PARETO 


PLOT  OF  LECTURES  AND  MAJOR  OPTIONS 
GIVING  COST,  PMU ,  AND  #ENH 


LIST  OF  LECTURES  AND  MAJOR  OPTIONS 


OPTION 

COSI 

PMU 

#FJ 

1.01 

SOO 

1 .96 

+1.02 

1000 

3.00 

+1.05 

1500 

3.82 

+L08 

2000 

4.53 

+L27 

2500 

5.19 

+L07 

3000 

5.68 

+L26 

350  0 

6.04 

+L03 

4000 

6.40 

+1.29 

450  0 

.6 . 76 

+L30 

50  0  0 

7.07 

+.L04 

5500 

7.29 

+1.3  6 

6000 

7.45 

+L31 

650  0 

7.59 

+L34 

7000 

7.72 

+1,12 

750  0 

7.83 

+L09 

8000 

7 . 94 

+U.5 

850  0 

8.01 

+L1 1 

90  0  0 

8.05 

+L3  3 

9500 

8. 05 

A-CPX2 

2374 

14.86 

0 

B-CPX3 

3562 

18.71 

0 

C-CPX4 

4750 

21 .27 

5 

II-FX2 

11476 

26.61 

0 

E-FX3 

17214 

30.83 

7 

F-FX4 

22952 

34.26 

17 

O-CAX 

86411 

26.95 

7 

H-CPX2 , FX2 

13850 

30.78 

0 

I-CPX2 , FX3 

19588 

34.03 

7 

J-HPX2,CAX 

88785 

32.48 

7 

CPL1 

2 . 20 

0 

CPt.2 

2.44 

0 

RFH1 

1.31 

0 

REM2 

1 . 96 

0 

Figure  2-9 

LIST  OF  LECTURES  AND  MAJOR  OPTIONS 
GIVING  COST,  PMU,  AND  «ENH 


27 


•  . - .  ••  •  ■ 
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POINTS  MADE  UP  FOR  EACH  TASK  BY  SPECIFIED  PACKAGE 
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task,  and  the  percent  PMU  for  the  task  (Percentage  of  the 
total  possible  PMU  made  up  by  that  package  currently  being 
considered) .  It  also  provides  the  cost,  PMU,  and  #ENH  for 
the  package . 
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3 . 0  SUMMARY 


This  final  report  has  described  the  conceptual  frame¬ 
work  and  technical  characteristics  for  the  prototype  cost- 
benefit  model  and  accompanying  computer  software  (called 
CTRACES)  which  has  been  developed  for  the  Marine  Corps 
Training  Requirements  and  Cost  Evaluation  System  (TRACES) . 
CTRACES  is  designed  to  help  battalion  commanders  develop  a 
cost-effective  strategy  for  allocating  remedial  training 
funds.  They  will  be  able  to  identify  how  many  points  and 
what  percentage  of  the  MCCRES  deficit  their  battalion  can  be 
expected  to  make  up  for  the  best  package  of  remedial  training 
options  at  a  specific  level  of  cost.  In  addition,  battalion 
commanders  will  be  able  to  evaluate  the  expected  benefit  and 
cost  of  particular  training  packages  that  they,  or  others, 
have  proposed  for  consideration. 

In  general,  CTRACES  will  provide  battalion  commanders 
with  the  following  information:  (1)  those  areas  in  which 
the  battalion  exhibited  performance  deficits  in  the  course 
of  its  MCCRES  evaluation;  (2)  the  different  training  options 
(or  activities)  that  can  be  exercised  to  improve  performance 
on  individual  tasks  within  each  Mission  Performance  Standard 
(MPS) ;  (3)  the  projected  remedial  training  benefit  of  each 
option  for  tasks  within  each  MPS:  (4)  the  projected  cost  of 
each  training  option;  (5)  the  projected  improvement  in 
combat  readiness  that  can  be  expected  for  specific  expen¬ 
ditures  of  training  funds;  (6)  the  expected  cost  required  to 
improve  the  battalion's  combat  readiness  by  a  specific 
amount;  and  (7)  better  (more  improvement  for  the  same  cost) 
and  cheaper  (less  cost  for  the  same  improvement)  alterna¬ 
tives  to  a  specified  training  package. 


The  conceptual  framework  of  the  benefit  model  within 
CTRACES  is  a  hierarchical,  multi-attribute  utility  model. 


The  top-level  factor  is  the  overall  benefit  produced  by  any 
proposed  package  of  training  options.  Overall  benefit  is 
decomposed  into  the  benefits  obtained  for  each  MPS,  which, 
in  turn,  is  decomposed  into  the  benefits  obtained  for  each 
of  the  tasks  comprising  the  MPS.  The  greater  overall  benefit 
is  obtained  by  training  activities  that  effectively  exercise 
important  tasks  within  important  performance  areas  on  which 
the  USMC  unit  performed  weakly.  The  most  cost-beneficial 
training  activities  are  those  that  most  effectively  exercise 
those  tasks  for  the  level  of  money  allocated  for  training. 

The  technical  characteristics  of  CTRACES  that  have  been 
discussed  include  details  on  the  following  items:  (1) 
inputs;  (2)  the  cost-benefit  algorithm;  and  (3)  outputs. 

The  key  inputs  to  CTRACES  involve  information  concerning 
MPS's  and  tasks,  remedial  training  options,  and  the  values 
of  the  remedial  training  options.  The  cost-benefit  algorithm 
essentially  aggregates  across  tasks  the  points  made  up  by 
each  training  option  and  selects  those  options  providing  the 
most  benefit  per  unit  cost.  Outputs  of  CTRACES  deal  with 
Potential  Points  Made  Up,  Pareto  Packages  and  Major  Options, 
and  Specified  Training  Packages. 

Through  this  effort,  the  USMC  has  been  provided  with  a 
fully  operational,  prototype  Training  Requirements  and  Cost 
Evaluation  System.  In  the  months  ahead,  TRACES  will  undergo 
field  testing  and,  no  doubt,  some  subsequent  modification. 

One  important  feature  which  might  be  added  to  CTRACES  would 
be  the  ability  for  individual  battalion  commanders  to  challenge 
the  PDMU  estimates  made  by  other  USMC  experts,  and  to  witness 
the  effects  of  these  modifications  on  TRACES  outputs.  This 
is  a  form  of  "what  if"  sensitivity  analysis.  It  is  impor¬ 
tant,  however,  to  rapidly  proceed  with  field  testing  of  the 
system  "as  is"  in  order  that  those  at  Headquarters,  USMC  can 
have  the  benefit  of  opinions  from  the  user  community  and  so 
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that  the  user  community  can  rapidly  begin  receiving  benefit 
from  the  newer  component  of  their  integrated  resource  manage¬ 
ment  system,  MCCRES/TRACES . 
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APPENDIX  A 


MATRICES  INDICATING  THE  APPROPRIATENESS  OF 
TRAINING  OPTIONS  FOR  TASKS 
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MISSION  PERFORMANCE  STANDARD:  20 -1  Amphibious  Assault  Planning 
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APPENDIX  B 


PERCENTAGE  OF  DEFICIT  MADE  UP  BY  TRAINING  OPTIONS 
AS  A  FUNCTION  OF  MPS  SCORES 
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MPS:  2B.3  Movement  to  Contact 
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MPS:  2B.  7  Retrograde 
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